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This study assessed the ability of the Sequential Organ Failure Assessment (SOFA) and Acute 
Physiology, Chronic Health Evaluation (APACHE) II scoring systems, as well as the 
Simplified Acute Physiology Score (SAPS) II method to predict group mortality in intensive 
care unit (ICU) patients who were poisoned with organophosphate. The medical records of 
149 organophosphate poisoned patients admitted to the ICU from September 2006 to 
December 2012 were retrospectively examined. The SOFA, APACHE II, and SAPS II were 
calculated based on initial laboratory data in the Emergency Department, and during the 
first 24 hr of ICU admission. The probability of death was calculated for each patient based 
on the SOFA score, APACHE II score, and SAPS II equations. The ability to predict group 
mortality by the SOFA score, APACHE II score, and SAPS II method was assessed using two 
by two decision matrices and receiver operating characteristic (ROC) curve analysis. A total 
of 131 patients (mean age, 61 yr) were enrolled. The sensitivities, specificities, and 
accuracies were 86.2%, 82.4%, and 83.2% for the SOFA score, respectively; 65.5%, 
68.6%, and 67.9% for the APACHE II scoring system, respectively; and 86.2%, 77.5%, 
and 79.4% for the SAPS II, respectively. The areas under the curve in the ROC curve 
analysis for the SOFA score, APACHE II scoring system, and SAPS II were 0.896, 0.71 6, and 
0.852, respectively. In conclusion, the SOFA, APACHE II, and SAPS II have different 
capability to discriminate and estimate early in-hospital mortality of organophosphate 
poisoned patients. The SOFA score is more useful in predicting mortality, and easier and 
simpler than the APACHE II and SAPS II. 
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INTRODUCTION 

Organophosphate (OP) poisoning is a major medical problem 
worldwide. The World Health Organization (WHO) has esti- 
mated that > 300 million case of acute pesticide poisoning oc- 
cur worldwide each year, and that most of these cases are due 
to OP intoxication (1). The mortality rate from acute OP poison- 
ing is 10%-20% (2-5), and WHO has estimated that 200,000 peo- 
ple die each year of pesticide poisoning. OP compounds increase 
the accumulation of acetylcholine in the synaptic cleft by inhib- 
iting acetylcholinesterase and decreasing acetylcholine degra- 
dation; thus, leading to excessively increased cholinergic activi- 
ty and cholinergic symptoms. Poisoning can occur through in- 
gestion, inhalation, or cutaneous exposure. Nerve gas agents 
are similar in structure and mechanism of action to OP insecti- 
cides but have a higher potency (5). 

OP insecticide ingestion is still a widely employed means of 
suicide with a high mortality rate despite great developments in 



intensive care (4). Although new advances in treating OP poi- 
soned patients in the intensive care unit (ICU) have resulted in 
increased survival, such measures prolong patient ICU stay and 
increase hospital expenses. Informing patients of the severity of 
the illness at the time of ICU admission helps determine con- 
tinuation of expensive treatment and avoids unnecessary pro- 
cedures. 

Use of scoring systems particularly developed for patient as- 
sessment at the time of ICU admission has reduced many prob- 
lems and facilitated treatment planning. The Sequential Organ 
Failure Assessment (SOFA) and Acute Physiology and Chronic 
Health Evaluation II (APACHE II) scoring systems, as well as the 
Simplified Acute Physiology Score II (SAPS II) are three tools 
widely used by most ICUs to predict clinical outcome. These 
scoring systems have been evaluated and validated in many 
centers and can be adjusted according to needs (7-10). 

The purpose of the this study was to evaluate the performance 
of SOFA, APACHE II, and SAPS II scoring systems for predicting 
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illness severity and the mortality of patients poisoned with OP 
who were admitted to the ICU. 

MATERIALS AND METHODS 
Study design 

This was a retrospective cohort study conducted from Septem- 
ber 2006 to December 2012. This study was conducted at a re- 
gional emergency center affiliated with an academic university 
hospital in Changwon, Korea. 

Data collection 

The medical records of OP poisoned patients admitted to the 
emergency center were carefully examined. Acute OP poison- 
ing was defined based on history of exposure, characteristic 
clinical features, and decreased serum cholinesterase activity. 
Patients with any of the following conditions were excluded: 1) 
an uncertain history of exposure; 2) combined drug exposures; 
3) exposure to OP for > 24 hr prior to presentation; 4) discharge 
against medical advice or transfer to another hospital; 5) pre- 
hospital cardiac arrest; 6) < 15 yr of age; 7) severe chronic ill- 
ness; or 8) missing data. Severe chronic illness included liver 
cirrhosis with portal hypertension, New York Heart Association 
class IV congestive heart failure, chronic respiratory disease, 
end-stage renal disease, or an immune-compromised state (e.g., 
leukemia, lymphoma, or AIDS). 

Medical records were carefully examined, and two investiga- 
tors collected the following parameters, age, gender, smoking 
status, presence of muscarinic and nicotinic symptoms, systolic 
and mean arterial blood pressure (mmHg), heart rate, respira- 
tory rate, body temperature, initial Glasgow Coma Scale score, 
arterial blood gas analysis (pH, Pa02, PaC02), F1O2, laboratory 
data (white blood cell count, hematocrit, platelet count, and se- 
rum levels of cholinesterase, sodium, potassium, creatinine, al- 
bumin, glucose, bilirubin, and C-reactive protein), use of me- 
chanical ventilation, seizure, pneumonia, pancreatitis, mortali- 
ty, SOFA score, APACHE II score, and SAPS II. The investigators 
who collected the data were blinded to the study objectives, and 
they both collected the same data and compared it for accuracy. 

The outcome parameter was 60-day mortality. The most ab- 
normal values for each parameter are typically observed within 
the first 24 hr after ICU admission. The SOFA score, APACHE II 
score, and SAPS II were calculated as described previously (7, 8, 
11). 

Statistical analysis 

Data were analyzed using SPSS version 21.0 (SPSS Inc., Chicago, 
IL, USA) and MedCalc version 12.2 (MedCalc Inc., Mariakerke, 
Belgium). Data are presented as mean ± standard deviation, 
median with interquartile range, or frequency. Differences be- 
tween the two groups were tested using the independent two- 



sample t-test or the Mann- Whitney U-test for continuous vari- 
ables and the chi-square test for categorical variables All vari- 
ables found to be significant in a univariate analysis underwent 
multivariate logistic regression analysis. The area under the re- 
ceiver operating characteristic (ROC) curve was calculated to 
determine the ability of the scores to discriminate using mortal- 
ity as an independent variable. The differences between the sen- 
sitivities, specificities, and accuracies of the scores were deter- 
mined using the McNemar test. Type I error was corrected by 
the Boneferroni's method for comparisons of three or more vari- 
ables. Calibration or the agreement between predicted mortality 
of the study population was examined with the Hosmer-Leme- 
show goodness-of-fit test and standardized mortality ratio (SMR) 
(defined as the actual population mortality divided by individ- 
ual patient predicted mortality) (12). A P < 0.05 was considered 
significant. 

Ethics statement 

The study protocol was reviewed and approved by the institu- 
tional review board of Samsung Changwon Hospital (IRB No. 
2013-SCMC-010-00). Informed consent was waived by the board. 

RESULTS 

Among the 149 patients, 131 were included from September 
2006 to December 2012, and 18 patients with the following con- 
ditions were excluded (Fig. 1). The average age was 61 yr (range, 
21-85 yr) and 82 (80.4%) patients were men. The general char- 
acteristics and laboratory data related to demographic and lab- 
oratory findings in both the survivor and non-survivor groups 
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Fig. 1. Organophosphate poisoned patients between September 2008 and February 
2013. 
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Table 1. Characteristics of survivors and non-survivors 



Parameters 


Qi in/iwnrc 
GUI VIVUI b 

(n = 1 02) 


Mnn ciir\/i\/Arc 
IMUI l oUl VIVUI o 

(n = 29) 


P values 


Age (yr) 


57.7 + 15.3 


76.3 + 10.3 


< 0.001 


Men 


82 (80.4%) 


22 (75.9%) 


0.595 


Heart rate (bpm) 


95.7 + 27.2 


81.8 + 24.8 


0.015 


MAP (mmHg) 


97.9 + 26.3 


73.6 + 38.0 


< 0.001 


GCS 


10 (3-15) 


3 (3-15) 


0.002 


WBC ( x lOVuL) 


15.1 (6.2-21.3) 


14.5 (5.9-19.8) 


0.323 


Hematocrit (%) 


42.8 + 3.9 


38.9 + 6.4 


0.004 


RR (Anin) 


18.3 + 6.4 


11.8 + 9.0 


0.001 


Albumin (mg/dL) 


4.0 + 0.4 


3.4 + 0.7 


< 0.001 


Glucose (mg/dL) 


200.3 + 90.6 


231.0 + 85.5 


0.106 


DUN \\\ iy/ui_j 


1 A A -t- O 


1 Q R -t- q n 
ly.o x y.u 


U.UU4 


Creatinine (mg/dL) 


0.9 + 0.2 


1.2 ± 0.4 


0.001 


Lactate (mM/L) 


4.4 + 2.9 


5.0 + 2.2 


0.285 


ChE (iu/L) 


798 (156-4,567) 


579(74-3,841) 


0.043 


CRP (mg/dL) 


21.2(0.1-93.4) 


9.5 (0.2-304.5) 


0.013 


APACHE II score 


9.2 + 4.9 


13.3 + 5.0 


< 0.001 


SAPS II score 


38.2 + 15.5 


62.1 + 17.4 


< 0.001 


SOFA score 


3.0 + 1.9 


6.7 + 2.2 


< 0.001 



Values are expressed as mean + standard deviation or frequency. MAP, mean arteri- 
al pressure; GCS, Glasgow Coma Scale; WBC, white blood cell count; RR, respiratory 
rate; ChE, cholinesterase; CRP, C-reactive protein (mg/dL); APACHE II, Acute Physiol- 
ogy and Chronic Health Evaluation II; SAPS II, Simplified Acute Physiology Score II; 
SOFA, Sequential Organ Failure Assessment. 

Table 2. Mean and standard deviation for the SOFA, APACHE II, and SAPS II values 



Assessment tools 


Survivors 


Non-survivors 


Pvalues 


SOFA 


0.083 + 0.1420 


0.756 + 0.3290 


< 0.001 


APACHE II 


0.076 + 0.0810 


0.614 + 0.3450 


< 0.001 


SAPS II 


0.089 + 0.176 


0.678 + 0.426 


< 0.001 



SOFA, Sequential Organ Failure Assessment; APACHE, Acute Physiology and Chronic 
Health Evaluation; SAPS II, Simplified Acute Physiology Score II. 



are summarized in Table 1. 

The mortality rate was 22. 1% (29 of 131). Twenty-four patients 
died in the hospital (82.8%), and five were discharged with im- 
pending death (17.2%). In the non-survivor group, the direct 
cause of death in 10 patients was complications of OP poison- 
ing (6 patients, pneumonia and sepsis; 4 patients, multiple or- 
gan failure). 

The scores of the non-surviving patients were significantly 
higher than those of the surviving patients. That is, the APACHE 
II scores were 13.3 ± 5.0 in the non-survivor group and 9.2 ± 4.9 
in the survivor group (P < 0.001). The SAPS II scores were 62.1 ± 
17.4 and 38.2 ± 15.5 in the non-survivor and survivor groups (P 
< 0.001), and the SOFA scores were 6.7 ± 2.2 and 3.0 ± 1.9 in the 
non-survivor and survivor groups, respectively (P < 0.001) (Ta- 
ble 1). 

The area under the ROC curve was calculated to evaluate the 
predictive value of the scoring systems. The APACHE II scoring 
system had an area of 0.716 and a cut-off value of 11, the SAPS 
II score had an area of 0.852 and a cut-off of 45, and the SOFA 
score had an area of 0.896 and a cut-off value of 4 (Fig. 2). 



>r 0.6 




0.4 0.6 
1 -Specificity 

Fig. 2. Receiver operating curves for predicting death according the Sequential Organ 
Failure Assessment (SOFA), Acute Physiology and Chronic Health Evaluation (APACHE) 
II, and Simplified Acute Physiology Score (SAPS) II scoring systems. The areas under 
the curve and 95% confidence intervals for these indicators were 0.896 (0.839-0.954) 
for SOFA, 0.716 (0.615-0.817) for APACHE II, and 0.852 (0.780-0.923) for SAPS II, 
respectively. 

Table 3. Sensitivities, specificities and accuracy rates of the SOFA, APACHE II, and 
SAPS II scoring systems for predicting mortality 



Diagnostic values 


SOFA 


APACHE II 


SAPS II 


Sensitivity 


25/29 


19/29* 


25/29 




(86.2%) 


(65.5%) 


(86.2%) 


Specificity 


84/102 


70/102* 


79/102* 




(82.4%) 


(68.6%) 


(77.5%) 


Accuracy rate 


109/131 


89/131* 


104/131* 




(83.2%) 


(67.9%) 


(79.4%) 



* t4 P< 0.05 vs SOFA (McNemar's test with Boneferroni's correction) SOFA, Sequen- 
tial Organ Failure Assessment; APACHE, Acute Physiology and Chronic Health Evalua- 
tion; SAPS II, Simplified Acute Physiology Score II. 



The probability of death estimates for the SOFA, APACHE II, 
and SAPS II are shown in Table 2 for the survivor and non-sur- 
vivor groups. The overall methods were significantly associated 
between survivors and non-survivors with good probability of 
death. The predictive power of the mortality estimates for the 
overall study population according to the SOFA, APACHE II, 
and SAPS II is shown in Table 3. The sensitivity of SOFA was re- 
markably higher than that of APACHE II (P < 0.001 vs SOFA), 
but was not significantly different from that of SAPS II (P = 0.200). 
The specificity of SOFA was also higher than that of APACHE II 
(P < 0.001) and SAPS II (P = 0.024). The accuracy rate of SOFA 
was higher than that of APACHE II (P < 0.001) and SAPS II (P = 
0.021). 

The SMR values for SOFA, APACHE II, and SAPS II were 0.70 
(95% confidence interval, 0.08-1.41), 0.76 (0.46-1.82), and 8.25 
(1.53-16.62), respectively. The chi-square values for the Leme- 
show-Hosmer goodness-of-fit statistic were 3.79 (P = 0.63), 7.71 
(P = 0.47), and 8.62 (P = 0.26), respectively. The Hosmer-Leme- 



1824 http://jkms.org 



http://dx.doi.org/10.3346/jkms.201 3.28.1 2.1 822 



Kim YH, et al. • Assessment of Organophosphate Poisoned Patients 



JKMS 



show goodness-of-fit test revealed no significant differences 
between actual mortality and predicted mortality for each of 
the scoring systems. 

DISCUSSION 

The SOFA score was developed during a consensus conference 
organized by the European Society of Intensive Care and Emer- 
gency Medicine (8). The SOFA score calculates a summary val- 
ue for the degree of dysfunction of six sets of organs (respirato- 
ry, coagulation, liver, cardiovascular, central nervous system, 
and renal). Four levels of dysfunction are identified for each of 
the organ systems in the SOFA score. Organ dysfunction is as- 
sociated with high rates of ICU morbidity and mortality, and, as 
such, treatment for these disorders accounts for a high propor- 
tion of the ICU budget (13, 14). In this study, although SOFA 
scores were calculated on the day of admission, SOFA scores 
were useful for predicting the outcomes of OP poisoned patients 
who were admitted to ICU. Furthermore, this methodology is 
simple compared to the other scoring systems. 

The APACHE II uses a point score based on initial values of 
12 routine physiological measurements, patient age, and medi- 
cal history to provide a general measure of disease severity in a 
patient. This system stratifies a wide variety of patients accord- 
ing to prognosis because of the strong and consistent relation- 
ship between acute physiological dysfunction and the risk of 
death due to acute illness (15-17). The APACHE II system serves 
as a useful index for evaluating the severity of poisoning due to 
multiple organ system involvement (10). In this study, APACHE 
II scores were useful for predicting the outcomes of OP poison- 
ed patients; however, the APACHE II system is highly complex. 

SAPS II was designed to measure disease severity in patients 
admitted to the ICU who are < 15 yr of age (7). A point score is 
calculated from 12 routine physiological measurements during 
the first 24 hr, information about health status, and some infor- 
mation obtained at admission. This calculation method results 
in a predicted mortality. Although SAPS II was useful for pre- 
dicting the outcomes of OP poisoned patients in our study, it is 
relatively complex, similar to the APACHE II scoring system. 

The two most popular systems introduced to date are APACHE 
II and SAPS II, which are based on multiple logistic regression 
equations describing abnormalities in physiological variables 
during the first 24 hr of ICU admission (7, 10). According to our 
results, we revealed strong calibration and discrimination pow- 
er despite the correlation between APACHE II and SAPS II. In 
addition, studying the correlation between APACHE II/SAPS II 
revealed the actual death rate. Kim et al. (18) reported that APA- 
CHE II and SAPS could indicate the predictor of mortality in OP 
poisoned patients. However, SOFA scores were easy to calculate 
and useful for predicting the outcomes of ICU OP poisoned pa- 
tients. The actual death rate revealed that a stronger relationship 



existed between SOFA scores and actual death rate, although a 
moderate correlation also existed for APACHE II and SAPS II. 

The severity of OP poisoning differs depending upon the na- 
ture of the compound and its quantity, the way through which 
the exposure has occurred and the time at which treatment is 
initiated. As long as OP poisoning patients are treated appropri- 
ately, their mortality reduced. There have been reported on me- 
thods in the severity and prognosis of OP toxicity. In our study, 
SOFA scores were easy to calculate and useful for predicting the 
outcomes of ICU OP poisoned patients. 

Our conclusions are limited by the single-center retrospec- 
tive nature of the study, and the results may lack wider applica- 
bility due to missing data and the small sample size. In addition, 
we could not determine the influence of the time difference be- 
tween the arrival of patients to the ED and the time they ingest- 
ed the poison because it was a retrospective study. Therefore, 
we suggest that a multi-center or a randomized trial be conduct- 
ed in the future to avoid these limitations and confirm our re- 
sults. 

In conclusion, the SOFA score is significantly associated with 
mortality and has strong discriminative power for predicting 
mortality. Considering the difficulty and complexity of measur- 
ing the APACHE II and SAPS II, the superiority of the SOFA score 
as a mortality predictor is understandable. The SOFA score is 
more useful than the APACHE II and SAPS II for predicting the 
outcomes of ICU OP poisoned patients, as the method for cal- 
culating SOFA scores is easier and simpler than that for APACHE 
II and SAPS II. 

DISCLOSURE 

The authors have no conflicts of interest to disclose. 
REFERENCES 

1. Jeyaratnam J. Acute pesticide poisoning: a major global health problem. 
WorldHealth Stat Q 1990; 43: 139-44. 

2. Senanayake N, Karalliedde L. Neurotoxic effects of organophosphorus 
insecticides: an intermediate syndrome. NEngl J Med 1987; 316: 761-3. 

3. Nouira S, Abroug F, Elatrous S, Boujdaria R, Bouchoucha S. Prognostic 
value of serum cholinesterase in organophosphate poisoning. Chest 1 994; 
106:1811-4. 

4. Tsao TC, luang YC, Lan RS, Shieh WB, Lee CH. Respiratoryfailure of 
acute organophosphate and carbamate poisoning. Chest 1990; 98: 631- 
6. 

5. Eddleston M, Gunnell D, Karunaratne A, de Silva D, Sheriff MH, Buck- 
ley NA. Epidemiology of intentional self-poisoning in rural Sri Lanka. Br 
J Psychiatry 2005; 187: 583-4. 

6. Sidell FR, Borak J. Chemical warfare agents: II. nerve agents. Ann Emerg 
Med 1992; 21: 865-71. 

7. Le Gall JR, Lemeshow S, Saulnier F. A new Simplified Acute Physiology 
Score (SAPS II) based on a European/North American Multicenter Study. 



http://dx.doi.Org/1 0.3346/jkms.201 3.28.1 2.1 822 



http://jkms.org 1825 



JKMS 



KimYH, etal. • Assessment of Organophosphate Poisoned Patients 



JAMA 1993; 270: 2957-63. 

8. Vincent JL, Moreno R, Takala J, Willatts S, De Mendonca A, Bruining H, 
Reinhart CK, Suter PM, Thijs LG. The SOFA (Sepsis-related Organ Fail- 
ure Assessment) score to describe organ dysfunction/failure: on behalf of 
the Working Group on Sepsis-Related Problems of the European Society 
of Intensive Care Medicine. Intensive Care Med 1996; 22: 707-10. 

9. Hargrove J, Nguyen HB. Bench-to-bedside review: outcome predictions 
for critically ill patients in the emergency department. Crit Care 2005; 9: 
376-83. 

10. Knaus WA, Draper EA, Wagner DP, Zimmerman JE. APACHE II: a se- 
verity of disease classification system. Crit Care Med 1985; 13: 818-29. 

1 1 . Vassar M J, Wilkerson CL, Duran PJ, Perry CA, Holcroft JW. Comparison 
of APACHE II, TRISS, and a proposed 24-hour ICU point system for pre- 
diction of outcome in ICU trauma patients. J Trauma 1992; 32: 490-9. 

12. Hosmer DW, Lemeshow S. Applied logistic regression. 2nd ed. New York: 
Wiley, 2000. 



13. Tran DD, Groeneveld AB, van der Meulen J, Nauta JJ, Strack van Schi- 
jndel RJ, Thijs LG. Age, chronic disease, sepsis, organ system failure, and 
mortality in a medical intensive care unit. Crit Care Med 1990; 18: 474-9. 

14. Deitch EA. Multiple organ failure: pathophysiology and potential future 
therapy. Ann Surg 1992; 216: 117-34. 

15. Knaus WA, Wanger DP, Draper EA. Relationship between acute physio- 
logic derangement and risk of death. J Chronic Dis 1 985; 38: 295-300. 

16. Wilson RE Gibson D, Percinel AK, All MA, Baker G, LeBlanc LP, Lucas C. 
Severe alkalosis in critically ill surgical patients. Arch Surg 1972; 105: 197- 
203. 

17. Shoemaker WP, Chang P, Czer L, Bland R, Shabot MM, State D. Cardio- 
respiratory monitoring in postoperative patients: I. prediction of out- 
come and severity of illness. Crit Care Med 1979; 7:237-42. 

18. Kim H, Han SB, Kim JS, Lee MJ, Park JS, Kwon WY, Eo EK, Oh BJ, Lee 
SW, Suh JH, et al. Clinical implication of acetylcholinesterase in acute 
organophosphate poisoning. ] Korean Soc Clin Toxicol 2008; 6: 25-31. 



1826 http://jkms.org 



http://dx.doi.Org/1 0.3346/jkms.201 3.28.1 2.1 822 



